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© Image assembly. 



© Apparatus for assembling images together in 
which each image is defined by respective pluralities 
of sets of data values, each set corresponding to a 
group of pixels of the image, the groups being 
arranged in a regular array across the image where- 
by the sets of data values can be obtained from sets 
of first data each defining the colour content of an 
image pixel in the group. The apparatus comprises a 
control system (9,10) for determining the position of 
a first image relative to a second image in a desired 
assembled image; and assembled image store (5); 
^and a modified image store (4). The control system 
p^is operable to convert the sets of data values of the 
(V) overlapping groups of pixels defining a region of the 
CO assembled images which overlaps and which is to 
Qbe retouched into the corresponding sets of first 
<w>data, consolidating the converted sets of first data 
CO into an assembled set of data, modifying the assem- 
Qbled set of data as desired, and storing the modified, 
assembled data set in the modified image store (4). 
Si The control system also assembles the two images 
together and stores the assembled images in the 
assembled image store (5), regions of the assem- 



bled image corresponding to previously modified 
regions being defined by the respective stored, as- 
sembled data set in the modified image store (4). 
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IMAGE ASSEMBLY 



The invention relates to methods and appara- 
tus for assembling images together. 

Conventional, high resolution image scanning 
techniques lead to the generation of digital repre- 
sentations of images having very large amounts of 
data Typically, a coloured image is represented by 
three or four colour components, for example, 
cyan, magenta, yellow, and black, the colour den- 
sity of each colour component being defined by an 
N bit digital value, where N is typically 8. ft will be 
appreciated that at pixel densities in the order of 
300 pixels/inch x -300 pixels/inch a considerable 
amount of data is generated. 

In order to reduce the amount of data for the 
purposes of storage or transmission, it is becoming 
the practice to compress the data using various 
compression techniques. One useful technique is 
to divide the image into groups of pixels, typically 
a regular, orthogonal array. Each group of pixels is 
then processed to reduce the data needed to de- 
fine the colour information. One form of data com- 
pression is to transform the spatial/pixel data into 
the frequency domain leading to the generation of 
a number of DC components and a larger number 
of AC components, the total amount of DC and AC 
data being much less than the total number of data 
values originally required to define the group of 
pixels in the spatial domain. 

One common form of image manipulation tech- 
nique is the assembly of two or more images 
together into a composite image. Conventionally, 
where the images are in a compressed form, this 
has been achieved by decompressing the com- 
pressed versions of the images and then overlay- 
ing the decompressed versions at their relative 
positions, the "upper" image being dominant in 
regions of overlap. In other words, where there is 
overlap between the regions, the pixel data of the 
assembled image will be that of the upper image 
and the corresponding pixel data of the lower im- 
age will be discarded. More complex forms of 
combination can also be achieved. 

The decompression of images into the spatial 
domain and the subsequent manipulation of those 
images in the spatial domain is a numerically in- 
tense task and hence time consuming. One pro- 
posal for reducing the time involved in assembling 
compressed images is described incEP-A-0278175? 

This recently proposed technique is useful in 
enabling compressed images to be combined with- 
out first completely decompressing the images into 
the spatial domain but a further requirement which 
is sometimes required is to be able to retouch or 
otherwise manipulate the assembled image. In the 
past, this has required the decompression of the 



assembled image into the spatial domain and again 
is a time consuming process. 

In accordance with one aspect of the present 
invention, a method of assembling images together 

5 in which each image is defined by respective plu- 
ralities of sets of data values, each set correspond- 
ing to a group of pixels of the image, the groups 
being arranged in a regular array across the image 
whereby the sets of data values can be obtained 

70 from sets of first data each defining the colour 
content of an image pixel in the group comprises 
determining the position of a first image relative to 
a second image in a desired assembled image; 
retouching at least one region of the assembled 

75 Image prior to the assembly step, the region in- 
cluding overlapping portions of said pixel groups of 
the first and second images, the retouching step 
comprising converting the sets of data values of 
the overlapping groups into the corresponding sets 

20 of first data, consolidating the converted sets of 
first data into an assembled set of data, modifying 
the assembled set of data as desired, and storing 
the modified, assembled data set and then assem- 
bling the two images together, regions of the as- 

25 sembJed image corresponding to previously modi- 
fied regions being defined by the respective stored, 
assembled data set 

In accordance with a second aspect of the 
present invention, apparatus for assembling images 

30 together in which each image is defined by respeov 

tive pluralities of sets of data values, each set 
corresponding to a group of pixels of the image, 
the groups being arranged in a regular array across 
the image whereby the sets of data values can be 

35 obtained from sets of first data each defining the 
colour content of an image pixel in the group, 
comprises control means for determining the posi- 
tion of a first Image relative to a second image in a 
desired assembled image; an assembled image 

40 store; and a modified image store, the control 
means being operable to convert the sets of data 
values of the overlapping groups of pixels defining 
a region of the assembled images which overlaps 
and which is to be retouched into the correspond- 

45 ing sets of first data, consolidating the converted 
sets of first data into an assembled set of data, 
modifying the assembled set of data as desired, 
and storing the modified, assembled data set in the 
modified image store, and the control means also 

so assembling the two images together and storing 
the assembled images in the assembled image 
store, regions of the assembled image correspond- 
ing to previously modified regions being defined by 
the respective stored, assembled data set In the 
modified image store. 
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With this invention, regions of the assembled 
image which are to be retouched are retouched or 
modified before the complete assembled image is 
generated. Thus, only those parts of the assembled 
image which are to be retouched need to be con- 
verted into the spatial domain while the bulk of the 
remaining assembled image can be left in the 
compressed form until final assembly is required. 
The final assembly process itself will typically com- 
prise the steps of converting the remaining sets of 
data values to the corresponding first data and then 
combining the images in a conventional manner. 

Typically, the method will be performed on a 
conventional image retouching system such as our 
Studio system, the retouching step being carried 
out by an operator who views the images to be 
assembled on a monitor screen. 

An example of apparatus for assembling im- 
ages using a method in accordance with the 
present invention will now be described with refer- 
ence to the accompanying drawings, in which:- 
Figure 1 is a block diagram of the apparatus; 
Figure 2 is a schematic flow diagram illus- 
trating operation of the apparatus; and, 

Figure 3 illustrates two tiles to be assem- 
bled. 

The apparatus shown in Figure 1 comprises a 
disc store 1 which stores a number of images each 
defined by compressed data. This compressed 
data may have been generated by initially scanning 
original pictures to generate 8 bit digital values, 
each representing respective ones of the cyan, 
,ma^genta,_ydipw,and black, colour .components of 
each pixel in the original image; dividing that repre- 
sentation of the image into tiles or blocks of pixels 
(typically 8x8 tiles); and for each tile transforming 
the spatial information defining the pixel data into 
the frequency domain and storing the coefficients 
of the frequency components. This is described in 
more detail in our copending European application 
mentioned above. 

The disc store 1 is connected to a decompres- 
sion circuit 2 which converts each tile of com- 
pressed data into the spatial domain by reversing 
the compression steps previously carried out 

The decompressed data is fed either to a 
frame store 3, or to a modified tile store 4, or to an 
assembled image store 5 as will be described in 
more detail below. Although this will typically be 
achieved by suitably addressing the data to one of 
these stores each of which will be connected by a 
common data bus, it has been shown more simply 
in Figure 1 by the use of a switch 6. 

Data loaded in the frame store 3 will define the 
content of each pixel of the selected part of an 
image in terms of its cyan, magenta, yellow and 
black colour components. To enable the pixel col- 



our to be displayed on a monitor 7, the colour 
component data is fed to a conventional colour 
converter 8 which converts the four colour compo- 
nents to values representing red. green, and blue 

5 which are used to control the monitor display. The 
apparatus is controlled by a microprocessor 9 and 
an operator actuable digitising table 10 connected 
to a common bus 11. 

In use, the operator first selects from the disc 

10 store 1 those images which he wishes to assemble 
into a composite image or page. This is achieved 
in a step 12 (Figure 2) in a conventonal manner by 
passing low resolution versions of these images via 
the decompression circuit 2 and a switch 6 to the 

75 frame store 3. The low resolution versions are then 
manipulated using the digitising table 10 to deter- 
mine their final relative positions which can be 
viewed on the monitor 7. In addition, the operator 
may decide to modify or retouch certain areas of 

20 the final, composite image. As mentioned above, in 
the past this could only be achieved after first 
assembling the final composite image by decom- 
pressing the full images on the disc store 1 and 
assembling them in the image store 5 at the de- 

25 compressed, high resolution. 

Instead, once the areas to be modified have 
been identified (step 13) the relative offset between 
the tile arrays of the overlapping images is cal- 
culated (step 14) by the microprocessor 9 and the 

30 tiles falling within the area or region to be modified 
are located. For example, Figure 3 illustrates two 8 
x 8 tiles 20, 21 of respective images which, in the 
final image, overlap by one pixel as indicated at 22. 
The operator wishes to retouch a , section inducting 

35 that overlapping region of 4 x 4 pixels indicated at 
23. 

The microprocessor 9 then causes all tiles hav- 
ing portions falling within the region 23 to be modi- 
fied to be down loaded from the disc store 1 and 

40 decompressed by the decompression circuit 2. 
These tiles 20, 21 are then consolidated or assem- 
bled in a conventional manner under the control of 
the microprocessor 9 (step 15) and the assembled 
version of these tiles is fed to the frame store 3 

45 allowing the assembled version to be displayed on 
the monitor 7. The operator then modifies this 
assembled region in a conventional manner by 
using the digitising table 10 to modify the colour 
content of the frame store 3. Once a finally desired 

so form for this region has been achieved, the relevant 
colour content of the frame store 3 is stored in the 
modified tile store 4. 

Once all areas to be retouched or modified 
have been retouched and stored int he modified 

55 tile store 4, the microprocessor 9 causes the full 
image to be assembled. This is achieved by de- 
compressing the remaining, unmodified tiles of 
each image as stored on the disc store 1 and 
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storing those decompressed tiles, after assembly, 
in the assembled image store 5. Where a region of 
the assembled image corresponds to a region 
stored in the store 4 which has been retouched, 
such as the region shown in Figure 3 the assem- 
bled image store 5 is caused to receive instead the 
corresponding modified data from the modified tile 
store 4 (step 16). 

Finally, the assembled image in the store 5 can 
be fed to the frame store 3 and displayed on the 
monitor 7 to check that the final assembly is cor- 
rect (step 17). 



Claims 

1. A method of assembling images together in 
which each image is defined by respective plural- 
ities of sets of data values, each set corresponding 
to a group of pixels of the image, the groups being 
arranged in a regular array across the image 
whereby the sets of data values can be obtained 
from sets of first data each defining the colour 
content of an image pixel in the group, the method 
comprising determining the position of a first image 
relative to a second image in a desired assembled 
image; retouching at least one region of the assem- 
bled image prior to the assembly step, the region 
including overlapping portions of said pixel groups 
of the first and second images, the retouching step 
comprising converting the sets of data values of 
the overlapping groups into the corresponding sets 
of first data, consolidating the converted sets of 
first data into an assembled set of data, modifying 
the assembled set of data as desired, and storing 
the modified, assembled data set: and then assem- 
bling the two images together, regions of the as- 
sembled image corresponding to previously modi- 
fied regions being defined by the respective stored, 
assembled data set. 

2. A method according to claim 1, wherein the 
step of assembling the two images together com- 
prises the steps of converting the remaining sets of 
data values to the corresponding first data and then 
combining the images. 

3. Apparatus for assembling images together in 
which each image is defined by respective plural- 
ities of sets of data values, each set corresponding 
to a group of pixels of the image, the groups being 
arranged in a regular array across the image 
whereby the sets of data values can be obtained 
from sets of first data each defining the colour 
content of an image pixel in the group, the appara- 
tus comprising control means (9,10) for determin- 
ing the position of a first image relative to a second 
image in a desired assembled image; an assem- 
bled image store (5); and a modified image store 
(4), the control means being operable to convert 



the sets of data values of the overlapping groups of 
pixels defining a region of the assembled images 
which overlaps and which is to be retouched into 
the corresponding sets of first data, consolidating 

s the converted sets of first data into an assembled 
set of data, modifying the assembled set of data as 
desired, and storing the modified, assembled data 
set in the modified image store (4), and the control 
means also assembling the two images together 

w and storing the assembled images in the assem- 
bled image store (5), regions of the assembled 
image corresponding to previously modified re- 
gions being defined by the respective stored, as- 
sembled data set in the modified image store (4). 

75 4. Apparatus according to claim 3, further com- 
prising a monitor (7) and a frame store (3), the 
control means. (9) being adapted to store the con- 
verted sets of data values in the frame store to 
enable them to be viewed on the monitor. 
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